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Abstract 

We examine various categorical structures that can and cannot be con¬ 
structed. We show that total computable functions can be mimicked by 
constructible functors. More generally, whatever can be done by a Turing 
machine can be constructed by categories. Since there are infinitary con¬ 
structions in category theory, it is shown that category theory is strictly 
more powerful than Turing machines. In particular, categories can solve 
the Halting Problem for Turing machines. We also show that categories 
can solve any problem in the arithmetic hierarchy. 


1 Introduction 

Categories are used in almost every branch of mathematics and theoretical com¬ 
puter science. As of late, a large part of theoretical physics also use categorical 
structures. There are, however, parts of mathematics that have not been con¬ 
ducive to categorical thinking. We are interested in what exactly can and cannot 
be constructed/computed/described using category theory? What is within its 
ability to describe and what is outside its ability? We shall use the words “con¬ 
structed,” “computed” and “described” interchangeably throughout this paper. 

In the 1930’s mathematicians asked what processes are computable and what 
processes are not. Although there was much intuition, there was no clear way to 
answer this question until there was a concrete model of computation. Alan Tur¬ 
ing introduced the idea of a Turing machine in order to formulate the intuitive 
notion of a computation. By fixing our ideas with one particular computational 
model, he was able to move the discussion forward. In a similar vain, if we 
are going to move forward investigating what can and cannot be described by 
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categories, we are going to need a concrete computational model of categorical 
constructions. 

In [H] I formulated a programming language that described categories, func¬ 
tors and natural transformations. The programing language was named Sammy 
in honor of Sammy Eilenberg who was one of the founders of category theory 
and who also had a deep interest in formal language theory and computability 
theory. Sammy has certain constants and its operations are simple categorical 
constructs (like composition of functors and Kan extensions of functors) that 
are used in everyday mathematical reasoning.We will examine what categorical 
structures can be constructed by a Sammy program and what structures cannot. 

In classical computability theory we are not only interested in what is com¬ 
putable but also in what is relative computable, that is, what is computable given 
other information. In this paper, we are not only interested in what structures 
are constructible but also in what structures are relative constructible. We will 
examine what structures are constructible when other structures are used in a 
Sammy program as inputs. As a simple example, it might be hard to construct 
the category of Lie groups out of the constants in the Sammy programing lan¬ 
guage, but it is not hard to construct if you are given the category of smooth 
manifolds. Lie groups are simply group objects in the category of smooth man¬ 
ifolds. 

Of course this only tells us what can and cannot be described by Sammy. 
What about other ways of describing categorical structures? There is a simi¬ 
lar problem in classical computability theory where the Turing machine is the 
computational model. This problem is dealt with by the Church-Turing thesis 
which states that everything that can be computed by any other computational 
model can also be computed by a Turing machine. More important is the con¬ 
trapositive of this thesis which says that whatever cannot be computed by a 
Turing machine cannot be computed by any other computational model. We 
believe an unprovable thesis that says that whatever can be constructed cate¬ 
gorically from basic terms can be constructed by a Sammy program. This gets 
complicated because many categorical structures are not constructible but are 
relatively constructible. 

Sammy rests heavily on the important work [5] of William Lawvere. In 
order to use category theory as a foundation of mathematics, he described first 
order axioms for the theory of categories. We are using categories as a way of 
describing structures and we use a programing language that has some similarity 
to those axioms. 

Some of our proofs of the fact that certain structures will not be constructible 
will be very similar to proofs of certain limitations in classical computability the¬ 
ory and classical Kolmogorov complexity theory. Usual computability limita¬ 
tions are based on variations of the self-referential liar paradox (“This statement 
is false”). Godel’s famous incompleteness theorem (“This statement is unprov¬ 
able”) and Turing’s unsolvability of the halting problem (“This program will 
output the wrong answer when asked if it will halt or go into an infinite loop”) 
are two such examples (see m and m for comprehensive surveys of such lim¬ 
itations.) In contrast, the limitations of Kolmogorov complexity are based on 
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the Berry Paradox: consider the number described by “The least number that 
needs more than fifteen words to describe it.” This sentence has twelve words. 
That is, there is a description of a number that is shorter than it is supposed 
to be. We will have a categorical version of such a limitation. 

This work grew out of our work in the Kolmogorov complexity of cate¬ 
gories [isiiiiiiz]- Classical Kolmogorov complexity describes how complicated 
a string is by looking at the shortest program that describes that string. If 
a short program exists to describe a string, then the string does not contain 
much information and is compressible. In contrast, if only a large program can 
describe a string, than it has a lot of information. If the only way to describe 
a string is to literally have it printed out, then it is extremely complex or, in 
other words, random. In |15j and in forthcoming papers we generalize classical 
Kolmogov complexity by looking at categorical structures as opposed to strings. 
In that work we needed the Sammy programing language to describe categor¬ 
ical structures. We are interested in the shortest Sammy program which is a 
description of that structure. In this work we use that programing language to 
decide what is and is not constructible. (Knowledge of [15] is not necessary to 
read this paper.) 

Another way to approach this work is via hyper-computation. Turing was 
one of the first people to formulate a concrete notion of computation with his 
Turing machine. Over the years others have formulated other notions. Most 
of these other notions were all shown to be equivalent to Turing machines and 
hence each other. There are, however, some notions of machines that are more 
powerful than Turing machines. A prominent examples is Joel Hamkins and 
Andy Lewis’s notion of an infinite time Turing machine. These are machines 
that can do an infinite amount of operations (see, e.g., [?])■ Another example 
is the Blum-Shub-Smale machine which can deal with the ring of real numbers 
as opposed to the usual natural numbers |2]. These models of computation, 
and several others, are more powerful than standard Turing machines. We look 
at category theory as a more powerful computational tool. Since it is used in 
standard mathematics and there are infinitary operations, one should expect it 
to do more. This paper describes some of the more powerful operations that it 
can perform. 

An analogy is in order. Godel’s incompleteness theorem tells us that for 
Peano arithmetic, there are some statements that are true but not provable 
within that system. In what sense are they true? They are true in the model 
of natural numbers, or another way to say this is that they are true in more 
powerful ZFC set theory. What about classical computability theory? For 
what larger, more powerful systems can the halting predicate be constructed? 
Category theory is such a system. We show that parts of classical computability 
theory can be worked out within category theory. 


This paper is organized as follows: Section 2 describes the Sammy program¬ 
ming language and has a mini-appendix on Kan liftings, one of the operations 
in the programing language. Section 3 gives several examples of structures that 
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are constructible, including some that cannot be done by regular computers. 
The next section discusses several constructions that are beyond the ability of 
Sammy. Section 5 shows the power of Sammy within the arithmetic hierarchy. 
The paper concludes with some possible ways this work can progress in the 
future. 

Acknowledgment. I thank Michael Barr, Joel Hamkins, Fred Linton, Robert 
Pare, Andrei Rodin, Robert Seely, David Spivak, and Jouko Vaananen for help¬ 
ful discussions. 


2 Describing Categorical Structures 

In order to fix our ideas, we formulate a programming language named Sammy 
that can be used to describe categorical structures. Most of the lines of the 
programming language will consist of an assignment statement that sets some 
variable equal to a categorical construction 

W := Dperation(X, Y, Z). 

The variables (W, X, Y, Z) can contain categories, functors, or natural trans¬ 
formations. They are set to constants or constructions built by operations on 
previously defined variables. The operations are typical operations that are used 
in the description of categorical structures to be described below. Some lines 
in the program will also have conditional breaks to control the execution of the 
program. 

The constant categories of Sammy are 0 , the empty category, 1 , the category 
with one object, 0, and 2, the category 0 —1 with two objects and one 
nontrivial morphism between them. We will also need the constant category 
Cat which corresponds to the category of all small categories. The constant 
functors are s : 1 —S’ 2 and t : 1 — 2 that picks out the source and target of 
2 . There is also the unique morphisms ! : 0 —S’ 1 , ! : 0 —s- 2 , ! : 0 —S’ Cat, 

! : Cat —S’ 1 , and ! : 2 — S’ 1 . There are also identity constant functors on 
0 , 1,2 and Cat. Sammy’s only constant natural transformations are identity 
natural transformations on the constant functors. 

There are several operations that take a single input. For a functor F : 
A —S’ B if we set C := Sourcei(F : A —> B) then C = A. That is, Sourcei 
takes a functor and outputs the category that is the source of the functor. There 
is a similar operation C := Targetj^(A : A —s- B). There are similar operations 
for natural transformations Source 2 and Target 2 . For a given category A, 
the operation F := Idento(A) has the effect that F = Wa.T here is a similar 
operations Identi for functors. For a category A, if we let C := Opq(A) then 
C = A°P. The Op]^ operation works on functors. 

One of the three main operation in categories is composition. For functor 
F : A —S' B and G : B —s- C we let F[ := Comp(F, G) be the composition of 
the two functors. If the target of the F is not the same as the source of G 
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then Sammy will output an error message. For natural transformations of the 
appropriate source and target Sammy has a horizontal composition and vertical 
composition written as a := Hcomp(/ 3 , 7 ) and a := Vcomp(/3, 7 ). For categories 
A and B, we will let C := Powo(A, B) be the category of all functors and natural 
transformations from A to B. The operation Powi is defined on functors and 
takes F : A —S’ B and G : C —> D and outputs the induced functor 

= G o - o F : C® —S’ 

Probably the most important operations are the Kan extensions. For cat¬ 
egories A, B and C and functors G : C —S- A and F : C —S- B, a right Kan 
extension of F along G is a pair {R, a) := KanEx(G, F) where R : A —> B and 
a : RoG — > F is a natural transformation that satisfies certain universal prop¬ 
erties. A left Kan extension can be described using the Opp operation on B. A 
Kan extension induces a natural transformation whenever another functor and 
natural transformation are given: for every H : A —s- B and /3 : H o G —S- F 
there is a unique 7 = KanExInd(G, F; H, (3) where 7 : FI —S’ R and satisfies 
Oi ■ 7G = P- The uniqueness of 7 basically says that the information in f3 is the 
same as the information in 7 . 

Using Kan extensions one can derive, products, coproducts, pushouts, pull¬ 
backs, equalizers, coequalizers, (and constructible) limits, colimits, ends, coends, 
etc. It is a well-known fact that if G : A —S’ B is a right adjoint (left adjoint, 
equivalence, isomorphism), then its left adjoint (right adjoint, quasi-inverse, in¬ 
verse) G* : B —S’ A can be found as a simple Kan extension of the identity Id^ 
along G, that it, G* = KanEx(G,/ c?a)’ 

In addition to Kan extensions Sammy also has right and left Kan liftings. 
Since these are less well known, we will have a mini-appendix about them at the 
end of this section. Briefly, for categories A, B and C and functors P : B —>■ C 
and a functor F : A —s- C, a right Kan lifting of F along P is constructed as 
{R,a) := KanLif(P, F) where R : A —S’ B and a : P o R —S’ F is a natural 
transformation which satisfies certain universal properties. There is also an 
induced Kan lifting natural transformation,that is, if we have a F : A —> B 
and a /3 : P o H —S’ F then we have an induced 7 = KanLif Ind(F, F; F,/3) 
where 7 : F —s- R and satisfies 7 = aoP(/3). A left Kan lifting can be described 
using the Opg operation on B. 

One can see these three operations — composition, extension and lifting — 
as three sides of a triangle: 


Lifting 


Composition 



Extension 


Another operation that will be needed is the composition operation, o. For 
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every category C, there is a functor o : Xci that takes pairs of 

composible arrows to their composition. 

Programs will not just be sequences of statements. Some lines will be given 
labels. There will be conditional statements of the form 

If a == P then goto L 

where a and /3 are natural transformations and L is a label of some line. When 
such a conditional statement is met, the program will evaluate to see if the two 
natural transformations are exactly the same and if so, execution of the program 
will go to the first line of the program with the label L. This will permit us to 
control the execution of the programs. These conditional statements can be used 
to not only compare natural transformations but also functors and categories. 

The last line of any program will Return(X, Y, Z) operation where X, Y and 
Z are different categorical structures. This will tell what structure are being 
defined by the program. There can be many parts to a structure. For example, 
a monad/triple is a category, an endofunctor and a few natural transformations 
that satisfy certain requirements. 

These seem to be the major operations needed to describe categorical struc¬ 
tures. We summarize all the operations of Sammy in Table 1 at the end of this 
paper. 

There are a few remarks that need to be stated about Sammy: 

• Numbers, strings, trees, graphs, arrays, and other typical data types are 
not mentioned in our programming language. The only types that Sammy 
deals with are categories, functors, and natural transformations. This was 
done on purpose. We want to emphasize that the usual data types can 
be derived from the categorical structures. Categories and algorithms are 
more “primitive” than numbers, strings, etc. 

• This is not the first time a programing language has been formulated to 
describe categorical structures. An important work in this area is Compu¬ 
tational Category Theory by Rydeheard and Burstall m- Another work 
found in the literature is Tatsuya Hagino’s thesis [B]. These languages 
are, however, different than Sammy. These programming languages were 
intended to be implemented and to get computers to actually calculate 
with categories. In contrast, Sammy is used to describe structures. As we 
shall see, Sammy cannot be implemented 

• Sammy might not the best or smallest programing language that can de¬ 
scribe categories. We could have used fewer operation. For example. 
Targetcould have been derived using Sourcei and Opj^. Similarly, one 
can derive Kan liftings using Kan extensions (limits and colimits). Since 
categories and functors are special types of natural transformations, we 
could have formulated most of our programming language with the single 
type of natural transformations. This, however, would have made Sammy 


6 


programs unreadable. Our goal is neither succinctness, cleverness, nor 
swiftness. Rather, our goal is clarity. 

• Sammy can never be totally implemented. While one can write compil¬ 
ers for such a language, the compilers will not always work. This can be 
seen when we prove later that Sammy can construct a functor that es¬ 
sentially solves the halting problem. Turing taught us that no computer 
can solve the halting problem. We can conclude from this that while 
Sammy can be partially implemented, we will never get any computer 
to run every Sammy program. (This is in line with similar statements 
about infinite-time Turing machines and other super-computable models 
of computation.) 

• There is a need for a Church-Turing type thesis. The classic Church- 
Turing thesis says that whatever can be computed, can be computed by 
a Turing machine. We need such a thesis that says that whatever can be 
constructed by categorical means, can be constructed using the Sammy 
programing language. We shall show this in the same way it is shown 
with Turing machines, namely we will show that many structures that 
one believes should be constructible, can be constructed by Sammy. Alas, 
this is a thesis and not a theorem because we cannot exactly characterize 
what can be constructed by categorical means. 

• We use the term “relative computable” or “relative constructible” for pro¬ 
grams that use already defined structures. For example, a program that 
describes the category of Lie groups might use the category of smooth 
manifolds as a given category. 

• Just as hardly anyone ever actually sits down and writes up the code for a 
Turing machine, so too, we have no intention to write much Sammy code 
to describe various constructions. Such programs would be too long, too 
complicated and not very enlightening. We do write some pseudo-code for 
Sammy programs in this paper and we will show in normal notation how 
different constructions are made. 

• Kan extensions (and Kan liftings) are only defined up to isomorphism.Hence, 
products, coproducts, equalizers, colimits, etc are also only defined up to 
isomorphism. We are left with the question as to which of the many 
possible Kan extensions does Sammy actually give. We leave this as 
implementation-dependent. Let the virtual machine choose one of them. 
Categorically they are all isomorphic and indistinguishable. 

• In [TS] we already showed how to construct equalizers, coequalizers, pull¬ 
backs, pushouts, comma categories, slice categories, the category 2 which 
is the category with two distinct objects and an isomorphism between 
them, and several other constructs. We will not repeat those construc¬ 
tions here. 
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• There are 20 types of commands in the Sammy programing language and 
the programs are of finite length. This makes it very easy to encode and 
decode a Sammy program as a finite number. For Sammy programs, a 
number will correspond to a functor P : 1 —> uj where uj is the to¬ 
tally ordered category of natural numbers. We will have functors de¬ 
scribing Sammy programs that deal with functors. This will give us the 
self-reference that is so central to computability theory. 

Formally, we say that a category A is constructable if there exists a Sammy 
program that Returns a category is isomorphic to A. There is a similar definition 
for functors. A natural transformation a is constructable if there exists a Sammy 
program that Returns aa.. 

Although Kolmogorov complexity of categories will not be the central focus 
of this paper, several such concepts will be used and need to be spelled out. 
When a certain structure is constructible by Sammy, we will be interested in 
what is the smallest number of Sammy operations needed to describe this struc¬ 
ture. For a structure X, its Kolmogorov complexity, Ksammyi^) = K(X) is 
the smallest number of operations in a Sammy program that can produce X. 
For two categorical structures X and Y, the relative Kolmogorov complexity, 
Aisammy (X|Y) = Ar(X|Y) is the smallest number of Sammy operations needed 
to describe X given that Y can be used as input to the program. 

If there is a finite number of operations so that one can go from one categori¬ 
cal structure to another and vice versa, we say that the Kolmogorov complexity 
of these categorical structures are approximately the same. In detail, if there 
exists a c such that for all appropriate categorical structures, X and X', one can 
change X to X' and vice versa in c Sammy operations, that is \K{X)—K{X')\ < c, 
then we write K(K) w K(K'). As an example, notice that only one Sammy op¬ 
eration is needed to go from category A to functor Id^ and vice versa. Hence 
K{A) « K{IdA). 

There is a need for something called an invariance theorem. The Kolmogorov 
complexity does not depend on the programing language that is used to describe 
the structures. Imagine another programming language to describe categorical 
structures called Saunders (after the other founder of category theory, Saun¬ 
ders Mac Lane.) Then since presumably both languages can program any 
constructible categorical structure, they can each program the other’s opera¬ 
tions. That means there exist compilers that can translate Sammy programs 
into Saunders programs and vice versa. From this, we can prove the following 
theorem: There exists a constant c such that for all categorical structures X we 
have \KSammyOQ — KSaunders{^)\ < c. The proof of this essentially lets c be 
the larger of the two possible compilers: The Sammy compiler in the Saunders 
language or the Saunders compiler in the Sammy language. By precomposing 
the appropriate compiler to a program in one language we get the program in 
the other language. 


A mini-appendix on Kan liftings. Kan extensions are well known and as 



Saunders Mac Lane proclaimed [3] “All concepts are Kan extensions.” Their 
cousins, Kan liftings, are less well known but we believe just as ubiquitous. In 
this appendix we familiarize ourselves with the basic properties and ideas of 
Kan liftings. 

Let A,B and C be three categories and let P : B —C be any functor. P 
induces a functor 

P o - = pA : B'^ — 

Left and right adjoints of P^, if they exists, are called left and right Kan liftings: 


Lp 



c^. 



Rp 


In detail, for F € and H we have 

B^(Pp(P),P) = C^(P,PoP) and B'^(P,Pp(P)) ^ C^(PoP,P). 

One can restate this in terms of universal properties. The following diagrams 
will be helpful: 


Lp{F) H 




A left Kan lifting of F along P is a functor Lp{F) and a natural transfor¬ 
mation a : P P o Lp{F) which is universal from P to P o —. This means 
that for any other F[ : A —B and /3 : P P o H there is a unique natural 
transformation 'j : Lp (P) => F[ such that 



Lp{F) 

7 


H 


That is, /3 = (P o 7 ) o a. 
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A right Kan lifting of F along P is a functor Rp{F) and a natural trans¬ 
formation a : P o Rp(F) F which is universal from P o — to F. This 
means for any H : A —> B and /3 : F[ =^> Rp{F), there is a unique natural 
transformation 7 : P o iJ =^> P such that 



H PoH 


That is, 7 = a o (P o (3). 

Kan liftings can be constructed with limits and colimits. First some prelim¬ 
inaries. For P : B —C, P : A — 5 - C and object a in A consider the comma 
category (P(a) j, P) which consists of arrows / : F{a) — 5 - P{h) in C for some b 
in B. The morphisms of this category consists of commuting triangles 


P(a) 



for some g : b —^ b' in B. This category has an obvious forgetful functor 
Qa ■ (P(a) i P) —5- B which sends / : F{a) —5- P{b) to b and sends the above 
diagram to the g : b — > b' arrow in B. Any h : a — > a' in A induces a functor 

h* : (P(aO I P) ^ (P(a) | P) 

which commutes with the forgetful functor: Qa' = Qah*. This means that 
whatever is in the image of Qa' will also be in the image of Qa- 

Kan extensions exist and can be described with limits and colimits when 
the target category has the proper limits and colimits. No requirements are 
made for the functors between the categories. In sharp contrast to this — and 
analogous to the algebraic topological notions — Kan liftings only exist when 
P is a continuous functor. 

If the left Kan lifting exists, it can be calculated on the object a G A as 

Pp(P)(a) = Lim{Qa ■ {F{a) | P) —5^ B). 

We have many steps in showing that this formula works. First, for any h : a — > 
a' we have that Qa' = Qah* we can see that there is an induced Lp{F){a) — >■ 
Lp{F){a') which shows that Lp{F) is functorial. 

The Definition of a : P P o Lp{F) is given as follows. A typical limit 
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looks like the following diagram in 



Apply P to this diagram and notice that by the continuity of P, we have that 
P{Lim) = Lim{P) we get the following diagram in C 



Since the F{a) also has arrows to everything in the limit, there is an induced 
Oa- Naturality of a can be seen by looking at the following commutative square: 



(The diagonal map is induced by the limit.) 

The universal property of a is derived as follows. Let H : A —5- B and 
/3 : F P o H. This means that for every a in A there is a map /3a : F{a) — > 
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P{H{a)). This map is necessarily in {F{a) P) which will look like 


m 



P{H{a)) 

Taking the forgetful functor, then the limit and then the P functor gives us this: 



The induced 7 a will come from the fact that H (a) is in the image of the forgetful 
functor. Naturality of 7 , which means the commutativity of the following square: 


Tp(F(a)) > Lp{F{a')) 



We leave this for the reader. 

Notice that if for a given a in A there exists a & in B such that F{a) = P{h) 
then id : F{a) —5- P{b) will be an initial object in {F{a) j, P). The limit of 
the forgetful functor Qa will then be isomorphic to b. Notice that if there are 
several 6 ’s that have this property, then they can all be the limits because they 
will all be isomorphic. 

The right Kan lifting is done similarly with the category {P j, F{a)) and a 
similar forgetful functor Q'^ : {P I F(a)) —5- B. The formula will be 

Rp{F){m) = Colim{Q'^ : {P F{a)) —> B). 

Rp{F) exists when B is cocomplete, and P : B — 5 - C preserves colimits. 
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3 Constructible Categorical Structures 

We begin by forming many little constructions that will be needed for the rest 
of the paper. Since classical computability and complexity theory is based on 
the natural numbers, we begin with a discussion of their construction. The 
coequalizer 

S 

1 ^ 2 — 

t 

gives the (infinite) natural numbers as a monoid. That is, N is the one-object 
category whose morphisms are the natural numbers. The totally ordered cat¬ 
egory of natural numbers is formulated as a slice category of the one object 
category. 

*/N = w= 0 — >1 — >2 —s-S —s----. 

In order to get the discrete of natural numbers we need a special type of 
categorical structure which we will call a iso-comma category . Whereas for 
functors L : A —> C and R : B —)■ C the objects of a comma category are 
morphisms of the form / : L{a) —> R{b) in C, here we need isomorphisms. 
We can construct the iso-comma category, denoted L IR from the following 
pullbacks: 


L ilR 



LilC 


CilR 



Using this construction we can get iso-slice categories C/ I c and iso-coslice 
categories cj I C. The obvious forgetful functors from L j, to C work as usual 
The discrete category of natural numbers is described as 

luj = ojd = 0 1 2 3 •••. 

This works because the only isomorphisms in u) are identity morphisms. There 
is the obvious inclusion tOd —> to which comes from the forgetful functor from 
the iso-coslice category. We will also need the category of natural numbers with 
isomorphisms between each number. This will come shortly. 

The group of integers comes in many forms. We can form the coeqaulizer 


1 toY[uj°p — ^c' 
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where the two maps point to the 0 G u! and the 0 G uj°p. This category looks 
like this 

C'= - 3 -< - 2 -^ - 1 ^ -0-- ^2 - ^3 -^ 

and is not very useful. A better category is obtained from the coequalizer 

S 

1 ^ 2 — 

t 

This gives us the group of integers as a one object category. Taking the slice 
category gives us 

Q = ^/I,= -^ 1 —^ 2—^3 

While the isomorphisms between the objects of this category are important and 
we could work with this category, classical computability and complexity theory 
works with the natural numbers and does not place any importance on negative 
numbers. We can collapse the negative numbers to 0 as follows: 


W _ Ci -^ 

inc 


where the c map is a constant at 0 and the inc map is the inclusion of the natural 
number into the integers. This coequalizer essentially collapses the nonegitive 
integers to zero and leaves the rest alone. The category 

uji= 0 —^ 1 —^ 2 —^ 3 —-. 

is the (negative) natural numbers with unique isomorphisms between them. 
Since the nonpositive natural numbers are isomorphic to the nonnegative natural 
numbers, it does not matter which we use. uji will be one of the major players 
in the tale we shall tell. 

Each of these three categories ( and ujd ) have advantages and disad¬ 
vantages. The uJd and uii do not have interesting limits or colimits. In contrast 
w is a good target category only for a nondecreasing function, is good as a 
target category for arbitrary functions.The three categories uJd uj uJi and 
the way we go from one to the other will be important. 

We will also be interested in operations on these ordered categories. The 
successor operation on w is defined by first constructing the successor operation 
on the monoid of natural numbers: 

succ : N N X 1 N x 2 N x N N 

where s is the source functor, p takes the single arrow in 2 to the hrst natural 
number, and o is the operation in the monoid. This functor works as it should: 
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succ{n) = n + 1.. With this, we can create the successor function on the linear 
order. Remembering that a slice category is a special type of comma category 
and for three functors L : A —>■ C, R : M —S’ C and H : C —S’ D there is an 
induced functor of comma categories: 

H^:{LiR)^ {{HL) i {HR)) 

which takes / : L{a) —S’ R{h) to H{f) : H{L{a)) —S’ H{R{h)). For the case of 
the total order of */N this becomes 

swcc* : w —> u) 

which works as it is supposed to. There is a similar operation that can easily 
be defined on Q and Wi. When there is no ambiguity around, we refer to all the 
successor functors as succ. 

A number, n G N, will correspond to a functor : 1 —> w such that 

P{0) = n. We can make similar definitions for C,i and If P is pointing to n, 

then succ o P : 1 — y uj —S’ w points to the successor of n. 

Finally we are ready to deal with computable functions. 

Definition 1 A total function f : — > N is constructible if there is a 

Sammy program that describes a functor F : ojf —S- oji such that for all 
xi,X 2 ,X 3 ,... ,Xk in the following square commutes 



Theorem 1 Any totally computable function of natural numbers is constructible 


Proof. First we show that the initial functions are constructible: 

• The zero function z : N —>■ N defined as z{n) = 0 is obtained as the 
composition of the unique function from uji to 1 and the pointer Pq : 
1 —S' Wi. That is, 

2 = PooLi : Wi —^ 1 —^ Wi- 

• The projection functions are simply categorical projections functors : 
oj) —S’ uJi for 1 < j < fc which are induced by the product. 

• The successor was already shown to be constructible. 
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We also must show that constructibility is preserved under the operations of 
composition, recursion and the /r-minimization operator. 

• Composition. If / is constructible by the functor F and g is constructible 
by the functor G, then function g o f will be described by a Sammy pro¬ 
gram that describes F and then G and then gives the composition of the 
functors. We have to erase the Return statement at the end of the pro¬ 
gram for F. More sophisticated versions of composition are also easily 
done. 

• Recursion. If h is defined via recursion from / and g as 

h{x,0) = fix) and h{x,n + 1) = gix,hix,n),n + 1) 

and if / and g are constructible by F and G, then H is constructible. First 
some preliminaries. We need to complete the natural numbers As we saw, 
N is the one object monoid of the natural numbers, and 2 is the category 
with two objects and one nontrivial morphism between them. We connect 
these two with the following coequalizer: 


1 NU2- 


The ! map is the unique map to the only object in the category N. The 
s map is to the source of the 2 . The category N' basically looks like the 
natural numbers with one nontrivial arrow coming out of it. N' has two 
objects: one from N and the target of 2. Take the slice category on the 
second object. Notice that this category is a totally ordered category of 
natural numbers but it also has a terminal object Idi : I — > 1 which we 
call uj. The category looks like this. 

w = N'/l = 0-^ 1-^ 2-^ 3--- w 

This category will help us do an infinite amount of work. Basically, we 
construct FI by an infinite iteration. 

1. P = Po : 1 —s- ZJ (This functor points to the initial element of ZJ) 

2. Pcj : 1 —^ ZJ (This functor points to the terminal element of w) 

3. Ind = * (This is the beginning of the index that will keep track of 
the functors.) 

4. H = F (Start the iteration. This is a functor from (wf x *) to Wj ) 

5. P = succ o P 

6. {H is a functor from (wf x Ind) to oji)) 

7. J = G o (Id X H) o A : uj^ —^ wf x wf —> co^ x to —> uj (The next 
iteration. This is a functor from (wf x *) to Wi)) 
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8. Use coequalizers to attach Ind to * using 2. This will increase Ind 
by one. 


01 2 —^ 3 


-k -^ -k 


n n + 1 



9. Let H be the induced new map from the new Ind category. [H = 

H]1J) 

10. If P ^ Pu) then goto 5. 

11. Return(iL) 

This program will take an infinite amount of steps to complete. But when 
it completes Ind will be LOi and H : —> iOi will mimic h. 

• /r-minimization. Let / : x N —>■ be a total function. The fx- 

minimization of / is a function g : —5- N that is defined for an 

X G as the smallest y such that f{x,y) = 0. We assume that / 
has the following property: for all x G there exists a. y G N such 
that f{x,y) = 0. This makes g a total function. If / is constructible by 
F : uj^ X oji —>■ uji then g will be constructible by G : wf —5- oji where G 
is defined by the composition of the double lines in the following diagram: 
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In detail, first precompose F to get the ojf x oj —^ wf x uji —s- uji. Also 
take the functor Pq : 1 —>• oji. Now take the pullback to get a. Notice 
that a is the full subcategory of Wi x a; of all the y such that y) = 0. 
We would like the smallest one of these. Both wf and a are completely 
connected groupoids and so to find the smallest one use a left Kan lifting 
L oi IdxO that picks out {x, 0) and the inclusion oi H. L will pick out find 
the least of all y in a. Notice the triangle on the left does not commute. 
Let 


G 


TT o inc o F[ o L : ujj 


a 


(jjf X UJ 


X (jJi 


UJi. 


□ 


While we can use computable functions to discuss computability, we can 
also use Turing machines. Turing machines are important for discussion of 
complexity. The usual definition of the time complexity of an algorithm is the 
amount of time clicks a Turing machine uses in order to complete its mission. If 
we are going to compare category theory with complexity, we will need to show 
how category theory can mimic Turing machines. 

Our Turing machine tape will be the category 

w= 0—^I— > 2 —S.3—S'---. 

The head of a the Turing machine will be a functor Pi : 1 — > uj pointing to the 
iih. position. To move the pointer to the right, we use the successor function: 

Pi+i = succ o Pi -.1 —y 00 —y Lo. 

Similarly, if : 1 —5- w points to the ith position, then the predecessor Pi-i : 
1 —> LO is constructed using the Kan lifting: 

1---cu (1) 



LO. 


This will permit us to move to the left and right on the Turing machine tape. 

If Pi : 1 — y LO points to the tth position on the tape, then the comma 
category constructions gives us truncated tapes: 

(lo iP^)= 0 -s- 1 -^ 2 -^ 3 ---- i - 1 -^ i 

and 

{Pi ~ ^^ t T I -^ i 2 -^ t T 3 -^ t -1- 4-• • •. 

There are canonical inclusions of these subcategories into co. These constructions 
will permit us to partition the tape and manipulate parts of it. 
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The tape alphabet will be {0,1, □} where the □ will correspond to the blank. 
Using coequalizers with copies of 2 and 2, it is easy to construct the following 
two categories and the inclusion of the first into the second 

3= 0-«-3= 0^-s-1. 



□ □ 


A functor F : w —5- 3 assigns a value in the tape alphabet to every position on 
the tape. F is a string in {0,1} if it starts at 0 or 1 and factors as follows: 



3 


(We can tell if a functor factors by taking a Kan lifting and seeing if the asso¬ 
ciated a is the identity natural transformation.) 

Now to deal with the contents of the tape. There are three distinguished 
functors 0 : 1 —> 3 , 1 : 1 —S’ 3 , and □ : 1 —S- 3 . The contents of ith position 
of a Turing machine tape is 

F o Pi : 1 —s- oj —s- 3 . 

If we would like to do some procedure when the zth position of the tape has a 
1 in it, we can use this in a Sammy program: 

If FoPi == 1 Goto L. 

We put all these parts together to make a Turing machine. First we use a 
Sammy program to make w, 3 and 3 . There will also be a variable qx which will 
point to some element of the discrete category (5 = {0,1,2,,...,|(5|} that will 
correspond to the state of the Turing machine. The input to the Turing machine 
will be given as a functor F : N —s- 3 . There will be a pointer Pq : 1 —^ N 
that begins by pointing at the zeroth position of the tape. What remains is 
to show how to translate a transition rule of a Turing machine into a Sammy 
program. 

Let us say that the Turing machine rule says 

<5(935, a) = iq52,b,D) 

where a,b € {0,1, □} and D G {R, L}. This rule will be done when the condi¬ 
tional 

If F o Fj == a AND qx == 35 Goto L 
is satisfied. If this condition is met, then the following algorithm in Sammy will 
be executed: 
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3 

1. Form Pi-i, (w Pi-i), and forgetful functor Ui-i : (w I Pi-i) —^ w. 
This is the left side of the tape. 


2. Form Pi+i, {Pi+i i w), and forgetful functor Ui+i : {Pi+i i w) —w. 
This is the right side of the tape. 

3. Use composition to form F o {7j_i : (w I Pi-i) —>■ w —5- 3 and F oUi+i : 
(Pi+i i oj) —>■ w — 3 . These two sides retain their old values. 

4. Consider b : 1 — 3 . This is the new value at point i of the tape. 

5. Use coeqalizers to attach (oj Pi-i) with 2 and 2 to 1 . Connect the left 
side of the tape to position i. 

6. Use coqualizers to attach 1 to 2 and 2 to {Pi+i w). Connect the right 
side of the tape to position i. 

7. Since all three of these parts have a map into 3 , there is an induced functor 
from the combination of all three parts into 3 . This is the new tape and 
values. 

8. Set qx = 52. 

9. li D = R then Pi is set to its successor, else Pi is set to its predecessor. 

Conclusion: We showed that for every rule of the Turing machine there is 
a set amount of steps of a Sammy program. Hence our programming language 
can do whatever Turing machines can do. For a string s, there is a functor 
Fg : uj —> 3 and our programming language can manipulate the Turing machine 
tape in the same way that the Turing machine would manipulate the tape. What 
this means is that for the computational complexity to create the functor Fg 
is the same as the computational complexity for a Turing machine to create s. 
The size of the Sammy program is, up to a multiplicative constant, the same 
as the number of rules in the Turing machine. In particular, if we consider the 
smallest programs, we get 
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Theorem 2 For every string s, KsammyiFs) = 0{Kciassicai{s)). 

In a sense, this says that our Kolmogorov complexity is a generalization of 
classical Kolmogorov complexity. 


We will need to look at the Kolmogorov complexity for numbers. 

In classical Kolmogorov complexity, for any natural number n, K(n) < 
log 2 n. For categories, the analogous theorem is as follows: 

Theorem 3 For any natural number n, the functor Pn : 1 —N can he con¬ 
structed by Sammy in 0{log2n) operations. That is, Ksammy{Pn) < 0{log2n). 

Proof. We must compose with the successor function n times on Pq in order 
to get Pn- Basically, the idea is that one can look at the binary representation 
of n and write a program based on that. For example 727 can be written in 
binary as lOIIOIOIII. We can express this number as 

(((((((((Ix2 + 0)x2 + l)x2 + l)x2 + 0)x2 + l)x2 + 0)x2 + l)x2 + l)x2 + l). 

Similarly, we can start with Pq and = Pi and then look at each digit of the 
binary expression of n and either 

(a) double the length between Pq and Px or 

(b) double the length between Pq and Px and then compose with the successor 
function one more time. 

For example the following algorithm will perform option (b): 

1 . Pt ■■= Po 

2 . Pend ■= Px 

3. If Pt == Pend then Goto 7 

4. Px := succ o Px 

5. Pt := succ o Pt 

6. Goto 3. 

7. Px '■= succ o Px 

8. Return(Pa;) 

For option (a), simply leave out line 7. 

For a given n, a Sammy program that will either consist of a sequence of 
option (a) or option (b) will perform the required task. The length of this 
program will be 6 or 7 times as long as log 2 n. 

In the above, for every natural number n there will be a different Sammy 
program. One can, instead, think of having the number n inputed as a binary 
string. Such a string will be a functor F : {uj f logn) —s- 2. A constant 
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sized Sammy program can then produce the functor Basically the Sammy 
program reads the input by looking at the functor F deciding at each point to 
do option (a) or option (b). The pseudo-code will look like this 

1. Pz := Po 

2. If F o Pj == 0, the perform option (a) else perform option (b) 

3. If Pj == Piogn then Goto 6 

4 . Pi := succ o Pi 

5. Goto 2. 

6. P„ := Px 

7. Return(P„) 

We have just proved that 

KsammyiPn '■ 1 -1 W | P : (w logu) - >2) = 0(1) 

where F describes n in binary. 

In the future we will need to know when a category is discrete. A is a discrete 
when the map induced by s : 1 —> 2 , 

A^ —S’ h} 

is an isomorphism. This basically says that the only morphisms in A is an 
isomorphism. 

We will also need to know when a category is connected. A is connected 
when 

{1 + 1 )^ = 1 + 1 . 

That is, a category is connected when there are exactly two morphisms from 
the category to the discrete category with two objects. 


The most celebrated limitation of theoretical computer science is that no 
computer can solve the halting problem. That is, if (py is the function that 
corresponds to the j/th computer program and x is an input, there is no computer 
program that can tell if (pyix) will halt or go into an infinite loop. The categorical 
analog for this problem is to construct the functor Flalt : uji x uJi —> 2 


F[alt{x, y) 


1 : if (j)y{x) I 

0 : if (pyix) t 


Whereas no regular computer can describe the halting predicate, categories 
can. 
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Theorem 4 Halt is a constructible functor. 

Proof. It is known that the predicate HaW defined as 


I 1 : if 4>y{x) within t steps 

Halt {x, y,t) = < 

I 0 : if (j)y{x) t within t steps 

is total and computable and hence constructible in Sammy. 

Notice that for a given x and y, once Halt'{x,y,t) becomes true, it remains 
true for any t' > t. This means that the constructible functor Halt" = Halt' o 
{inc X inc x Id) : ujd x cod x coi —s- uji x uji x tUi — > 2 factors through 2 as in 



Another way to say this is that the Kan lifting of Halt” is Halttf. 

Halt^, can be used in the following right Kan extension to construct the 
Halting functor: 


(incTT^) X {inc^ 

LOdXLUdX LOi. 

For a given x and y, the halt functor has the value 

Colim{0 ——>0 — >0 —>0 —>0 —^0 —^•••)=0 

if program y does not halt on input x. In contrast, if program y on input x does 
eventually halt, then the value of the functor is 

Colim{Q —^0 —>0 — >0 — >0 —>0 —^•••0 —>0 —^I —>I ——^I —).••■) = I. 



We will use these idea again in Section 5. 

Essentially this follows from the intuition that 

Halt{x,y) = ColimittHalt'(x,y,t). 

This should however not be surprising since categories can do infinitary op¬ 
erations. However this says something about implementations of Sammy. To 
reiterate what was said above: since we know from the Turing’s halting theorem 
and the Church-Turing thesis that the halting problem cannot be solved by any 
computer, we know that the Sammy programming language can not be totally 
implemented on any computer. 


23 




4 Nonconstructible Categorical Structures 

Not every categorical structure is constructible. A simple counting argument can 
be used to see this. A functor oj — 2 corresponds to a real number. Therefore 
there exists uncountably infinite functors from a; to 2. However, every Sammy 
program can be encoded as a natural number. This means that there are only 
countably infinite constructable functors from a; to 2. The vast vast majority 
of structures are not constructible. 

A concrete example of a functor that is not constructible is Ksammy It is 
well known Kciassicai '■ Strings —> N is not a computable function. First let us 
be careful about the definition of Ksammy It is a functor that assigns to every 
category, functor, and natural transformation a natural number. We might as 
well assume that it only assigns natural transformations since identity natural 
transformations are simply functors and identity functors are simply categories. 
Let us think of Cat as the discrete category of natural transformation. We are 
going to forget the (two) composition structures on Cat because Ksammy does 
not behave well with respect to maps. Another problem is that not all elements 
of Cat are constructible. If X is not constructible we shall let KsammyO^) = oo- 
So we have a functor Ksammy '■ Cat — > uJ where aJ = w U oo is the completed 
natural numbers. 

Theorem 5 Ksammy '■ Cat — s- w is not constructible. 

Proof. The proof is a self-referential proof by contradiction argument similar 
to the Berry paradox. Assume (wrongly) that K = Ksammy is, in fact, con¬ 
structible, then there is a shortest program that creates K. So we can ask for 
the finite value of K{K) (this is the core of self reference!). Let K{K) = c. Let 
n be a natural number and let Pn ■ 1 —> w be a functor such that (0) = n. 
Now use K and and P„ to construct the following pullback: 

CatrS -^ Cat 


K 

{Pn i UJ)^ -s- W. 

{Pn 4 w) is the sub-total order of the completed natural numbers that start at 
n. Catn is the discrete set of natural transformations whose shortest program 
is greater than or equal to n lines. For any n, to construct Catn one needs 

1. c lines of code to construct K 

2. logn lines to construct Pn 

3. and a few lines to construct the pullback. Call this small number pb. 
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That is, Catn can be constructed in c+logn+pb lines or K{Catn) < c+log n+pb. 
Chose an n such that n » c + log n + pb. Then Cain contains objects that 
require n or more lines of code (or are unconstructible) while we just described 
Cat„ in c + log n+pb lines of code. This is like a Berry sentence. Contradiction! 
The only thing assumed is that K was constructible. It is not constructible. 

What else is not constructible? Consider the functor that determines if a 
categorical structure is constructible or not. The functor Cons : Cat — > 2 
which accepts a natural transformation and tells if that natural transformation 
is constructible or not. While, at the moment, I cannot prove it, I conjecture 
that Cons is not constructible. 

In the last section we showed that one can write a Sammy program to solve 
the halting problem for classical Turing machines. What about the halting 
problem for Sammy programs? There are several issues here to deal with. First 
off. We have seen that some programs will go on for to steps and then stop. This 
is similar to the infinite time Turing machines. Do we say that such problems 
halt? Another point is that the halting problem is not about a program halting, 
rather it is about a program and an input to the program. The analogous 
categorical question would ask about a functor F : A —> B and a input functor 
I : * —A. With these two functors we can ask if F o J is defined or is 
constructible. 

Throughout this paper, the structures that we dealt with were totally de¬ 
fined. Category theory usually deals with totally defined structures. Mathe¬ 
maticians do not talk about “partially defined cohomology functors.” Physicists 
generally do not talk of “a partially defined Lagrangian.” In fact, essentially 
the only time that category theorists talk about partial functors is to mimic 
something from computability theory. 

So even though this is orthogonal to our main purpose, we will spend a 
little time looking at partially defined functors. In the spirit of [4] one can 
define a partial functor F : C —> D as a pair(incF, Fq) where incp is an 
inclusion of a subcategory incp ■ Cf — > C and Fq : Co —> D is a functor 
from that subcategory to D. Composition of F = (fncF, Fq) : C — 5- D and 
G = {incG, Go) : D —>• E is given by the following pullback: 




Cf Mg 
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The problem with this is that composition is only associative up to a natural 
transformation. This takes us out of the domain of category theory and into 
the the field of bicategories. One would have to formulate the notion of a nat¬ 
ural transformation between two partial functors and then go on to describe 
Kan extensions and Kan liftings of partial functors. The Sammy programing 
language would have to be modified to Sammy’ which describes categories, par¬ 
tial functors and partial natural transformations between them. In this setting, 
there will be many analogs to the theorems in classical computability theory. 
Sammy’ programs are very simple objects. Sammy’ only has a finite number of 
operations and each Sammy’ program consists of a finite number of lines. So 
every Sammy’ program can be encoded as a finite number and hence a functor 
P : 1 — > uj. From this it follows that we can enumerate all Sammy’ programs. 

We are only interested in Sammy’ programs whose returned value is a partial 
functor uJi — 2 . Formally, let (/)^ : Ui — 2 be the partial functor described 
by the nth Sammy’ program. If the nth program describes a partial functor 
from a different source or target category, then let it be undefined. Let x and y 
both be thought of as natural numbers and as functors 1 — > uj. Consider the 
functor Halt^ : uji x uji —)• 2 that is defined as 


Halt^{x, y) 


1 : ii4>l (x) i 
0 : if (x) t 


Theorem 6 The total functor Halt^ is not a constructible functor. 


Proof. The proof will follow the usual self-referential ideas found in the classical 
proof that the halting problem is unsolvable (see e.g. [13].) Assume (wrongly) 
that Halt^ : uJi X u!i —> 2 was a total constructible functor. We can compose 
this total functor with the following easily constructible total functors A : uJi —> 
uJi X UJ and NOT : 2 —> 2 such that NOT{0) — 1 and N0T{1) = 0 and get 


UJi X U!i 


HalP 


2 


A 


NOT 


1 


D 


2 . 


By composition we get the functor D : uJi — > 2 (for diagonal). D is dehned so 
that D(n) = 1 iff Sammy’ program n on input n is not constructible. If Halt^ 
was constructible than D would be constructible and there would be a program 
number, say y, for this program. That is D = cjjy : uoi —> 2 . Composing D 
with Py : 1 — > uJi would make a functor 

D o Py = (j)y o Py : 1 —^ uJi — > 2 . 
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We then have 


(y) = 1 iff D{y) = 1 iff NOT{Halt^{y,y)) = 1 iff Halt^iy,y) = 0 iff (l)y{y) = 0 

We conclude that D cannot be constructible which means that Halt^ cannot 
be constructible. 


5 The Arithmetic and Analytic Hierarchies 

Logicians have defined several hierarchies of logical predicates. The simplest 
one is called the arithmetic hierarchy. This is the class of predicates or relations 
on natural numbers that are either recursive or can be gotten from recursive 
relations from either complementation and/or projections. Complementation 
corresponds to the operation while projection corresponds to 3. Noticing 
that V = and that, in general, quantifiers can be brought to the beginning 
of a logical formula, we can write all predicates in the arithmetic hierarchy as a 
sequence of existential and universal quantifiers followed by a recursive relation. 
The classification is then based on whether the first quantifier is a existential 
or universal, and on the number of alterations between the types of quantifiers. 
A predicate that can be expressed as an existential quantifier followed by n 
alterations between universal and existential quantifiers will be called ^ 

predicate that can be expressed with a universal quantifier followed by n alter¬ 
ations will be called ]/[°. Our main source and our notation will follow chapters 
14-16 of [To]. 

Theorem 7 Every predicate in the arithmetic hierarchy is constructible. 
Proof. The proof is by induction on the complexity of the predicate. 

• If is a recursive predicate of n variables, then, since we can think of 2 as 
a subcategory of Wi, and as we saw about such recursive functions, there 
is a constructible functor $ : w/ —> 2 that mimics 4>. 

• If (/ = -i'0, and ip is mimicked by the constructible 4/ : w/ —> 2, then (f) 
is mimicked by the composition of constructible functors 

$ = not o 4' : w/ —>2 —>2 

where NOT is the easily constructed functor that such that NOT{0) = 1 
and NOT{l) = 0. 

• Let (p = 3x'0 where tjj is n + 1 variable predicate that is mimicked by 

4' : —s> 2. We shall construct $ : w” —2 in four steps. 

1. Change the source of 4' to be partially discrete 

vl/' = v[/ o (inc” X Id) : X LOi — > x uii —2. 

We will need this so that step 3 will work out well. 
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2. Change the target of 'h'. Since there are no nontrivial limits or 
colimits in 2 we must change the target category to 2 using a Kan 
lifting: 


2 

3. Now we use t|> in the following right Kan extension 




X UJi 

4. To get back a functor whose range is 2 we simply compose $ with 
the obvious inclusion of 2 to 2: 

$ : w ” —>2 — > 2 . 

We do these inductive steps for each complimentation and projection. In the 
end, we get a functor 1 —5- 2 which tells the truth or falsity of the predicate. 

While we showed that categories can deal with all of the arithmetic hierarchy, 
we left open the question of the analytic hierarchy? Categories cannot solve 
everything. As we saw, they cannot construct the Ksammy functor. So what 
exactly is the power of categories? 

In a sense, set theory can describe all the effective hierarchies and hence is 
less interesting. In contrast, category theory is limited. Some problems they can 
solve and some they cannot. This makes the study of the effective hierarchies 
from the categorical standpoint important. 

An interesting problems in the analytic hierarchy is to determine if a given 
real number is a rational number. It is interesting to look at the problem from 
a categorical point of view. Think of a real number as a functor r : to —> 2. In 
order to describe a rational number we need the notion of a lollipop. For every 
two nonnegative integers m < n, we shall call the following partially ordered 
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category Lm,n 

0 -s- 1 -s- 2 -s- • • • -s- TO — 1 -s- TO-s- TO + 1 -s- TO + 2 


n — 1 ^-n — 2 -n — 3 

There is always a canonical projection w —> Lm,n- It is not hard to see that r 
is rational number if there is some to and n such that r factors as 

2 . 


m,n 

One can look at the category of lollipops with w as the initial object and 1 = Lo,o 
as the terminal object. However it is not clear how one constructs this category 
of lollipops or sees if an arbitrary real number factors through any of them. 
Much work remains. 




6 Future Directions 

We see this paper as just the beginning of a larger project to understand the 
computability and complexity of categorical structures. There are many more 
subjects that we would like to attack with the tools developed here. Here are a 
few of them. 

Complexity Measures. We would like to better clarify what is constructible 
and what is not. We discussed the Kolmogorov complexity of categorical struc¬ 
tures. We would also like to study different complexity measures on these struc¬ 
tures. Rather than asking what is the shortest program that produces a cat¬ 
egorical structure, we can ask how much time/space does a program take to 
create a certain structure. That is, what is the computational complexity of a 
structure. We can also ask how much time does it take for the shortest program 
to produce that structure (Bennett’s logical depth). Another measures of inter¬ 
est are Adelmann’s time-bounded Kolmogorov complexity. All these measures 
induce hierarchies and classifications of categorical structures. 

Entropy. There is a relationship between classical Kolmogorov complexity 
and Shannon’s complexity theory. Classical Kolmogorov complexity measures 
the complexity of an individual string while Shannon’s complexity measures 
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the complexity of a source of strings, or a whole class of strings. Shannon’s 
entropy function, H, measures how much rigidity there is in the source. Or 
to put it another way, how many different ways can the strings be swapped. 
The relationship says that if X is a source of messages or a class of messages, 
than H{X) is about the average of all the K{x) where x is a string that can be 
produced by X. Formally, 


H{X) ^ ^ p{xi)K{xi). 

Xi^X 

We would like to formulate a notion of Shannon’s complexity theory for 
categories. There should be a definition of entropy of a category. This should 
measure how rigid or flexible a categorical structure is. Let C be a category, 
then Aut{C) is the group of automorphism functors F : C —5- C. Define the 
“entropy” (or “Hartley entropy”) of C as H{C) = Log 2 \Aut{C)\ (perhaps this 
should be H{C) = pLog 2 |y^„t(C)| "''’here p is some constant.) There is a similar 
definition for the “entropy” of a functor F : C — > H) as H{F) = Log 2 \Aut{F)\ 
where we mean the set of iso-natural transformations F —5- F. We might look at 
the entropy of a particular object c of C as the entropy of the functor c : 1 —^ C 
that “picks” an object c S C. F[{c) = H{c : 1 —C) = Log 2 \Aut{c)\. It 
would be interesting to see the relationship between such entropy measures for 
categories and functors with KsammyiC) and Ksammy{c '■ 1 —> C). Just as 
there is a relationship between these measures for strings, there should be a 
relationship for categorical structures. 

Categories With Structure. So far we have restricted to classical categories, 
functors, and natural transformations. But that is not the whole story. What 
about categories with more structure? For example, what can we say about 
a category that we know has all limits and colimits? What about enriched 
categories, 2-categories, n-categories, weak-n-categories, quasi-categories, cate¬ 
gories with Quillen model structures (i.e., the ability to do homotopy theory) 
etc? These different structures have been applied in almost every area of math¬ 
ematics, computer science and theoretical physics. For each of these classes of 
categories with structure, we are going to have to come up with another Sammy 
programing language that can deal with such structure. We are interested in 
what structures of these types can and cannot be constructed and what is their 
complexity. For example when dealing with 2-categories, we might be interested 
in given the category B to construct the 2-category Fib{M) of fibrations over B. 
We also would like to see its relationship with [B°p, Cat]. 

Computational Complexity Theory. There is an intuition that the differ¬ 
ence between P and NP is that the solution space for P is somehow structured 
while the solution space for NP is unstructured. An algorithm in P uses the 
structure of the solution space to find the correct solution efficiently. In con¬ 
trast, the only known way of solving an NP problem is to perform a brute-force 
search through the unstructured solution space. We believe that it should be 
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possible to formalize this intuition with our Kolmogorov complexity of cate¬ 
gories. What does it mean for a solution space to have a workable structure? 
Most of the solution spaces for NP problems do have some type of structure. 
They usually form an exponential tree. Why is that not good enough? What 
about other complexity classes. How does PSPACE compare with NP? There 
must be some type of trade-off between the size of the solution space and the 
amount of structure of the solution space. If the size is very large but there is a 
lot of structure, then the problem could still be effectively solved. In contrast, 
if the solution space is relatively small but there is little structure, the problem 
will be hard to solve. We hope to examine this notion of structured solution 
space with Kolmogorov complexity. 
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Table 1: Operations in the Sammy Programming Language 


Operation 

Input 

Output 

Note 

Sourcei 

Functor 

Category 

Source of the functor 

Source 2 

N.T. 

Functor 

Source of the N.T. 

Target 

Functor 

Category 

Target of the functor 

Target2 

N.T. 

Functor 

Target of the N.T. 

Idento 

Category 

Functor 

Identity functor of a category 

Identi 

Functor 

N.T. 

Identity N.T. of a functor 

DPo 

Category 

Category 

Opposite category 

DPi 

Functor 

Functor 

Opposite functor 

Comp 

2 composable funcs 

Functor 

Composition of functors 

Hcomp 

2 composable N.T. 

N.T. 

Horizontal composition of N.T.s 

Vcomp 

2 composable N.T. 

N.T. 

Vertical composition of N.T.s 

Powq 

2 categories 

Category 

Power category 

Powi 

2 functors 

Functor 

Power functor 

KanEx 

2 functors 

Functor & N.T. 

Right Kan extension 

KanExInd 

3 functors and a N.T. 

N.T. 

Induced by right Kan extension 

KanLif 

2 functors 

Functor & N.T. 

Right Kan lifting 

KanLifInd 

3 functors and a N.T. 

N.T. 

Induced by right Kan lifting 

o 

Category 

Functor 

The functor Xci —)■ 

If 

2 N.T.s and label 


Conditional break operation 

Return 

Cat, func and/ or NT 


Final statement of a program 
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